Coherent Texture Synthesis for Photograph Relighting and Texture Transfer

This paper presents a texture synthesis method for relighting and texture transfer. This method is based on the observation that many points on the surface of a textured object share the same material but have different normals. Hence, once we identify these points, we collect many samples of a material under different illuminations. Hence, we can relight the object by interpolating similar lighting conditions. Furthermore, we can transfer the texture to other objects under different illuminations. We acquire the source textured object by taking a few photographs for a fixed viewpoint under controlled lighting. Stereo is used to estimate the normal map and the unshaded material map of the source object. Then, points of the same material are recognized by neighborhood matching of pixel values of unshaded material map. Finally, we can transfer the texture to another object and render it under different illumination conditions using these clustered texels.